WAVELET  AND  VECTOR  QUANTIZATION  IMAGE  COMPRESSION  FOR 
NOISY  CHANNEL  TRANSMISSION 


FINAL  PROGRESS  REPORT 


Eve  A.  Riskin  and  Richard  Ladner 


January  21 , 2000 


U.  S.  ARMY  RESEARCH  OFFICE 
Grant  No.  DAAH04-96-1 -0255 


University  of  Washington 


Approved  for  Public  Release; 
Distribution  Unlimited. 


THE  VIEWS,  OPINIONS,  AND/OR  FINDINGS  CONTAINED  IN  THIS  REPORT  ARE 
THOSE  OF  THE  AUTHOR(S)  AND  SHOULD  NOT  BE  CONSTRUED  AS  AN  OFFICIAL 
DEPARTMENT  OF  THE  ARMY  POSITION,  POLICY,  OR  DECISION,  UNLESS  SO 
DESIGNATED  BY  OTHER  DOUMENTATION. 


20000628  164 


DTIC  QUALITY  INSPECTED  4 


SF  298  MASTER  COFY 


KEEP  THIS  COPY  FOR  REPRODUCTION  PURPOSES 


< 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  NO.  0704-0188 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources, 
gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comment  regarding  this  burden  estimates  or  any  other  aspect  of  this 
collection  of  information,  including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Sen/ices,  Directorate  for  information  Operations  and  Reports.  1215  Jefferson 

Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of  Management  and  Budget,  Paperwork  Reduction  Project  (0704-0188),  Washington,  DC  20503. 

1.  AGENCY  USE  ONLY  (Leave  blank)  2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATES  COVERED 

1/21/00  Final  Report  -  07/01/96  -  12/31/99 

4.  TITLE  AND  SUBTITLE 

Wavelet  and  Vector  Quantization  Image  Compression 
for  Noisy  Channel  Transmission 

5.  FUNDING  NUMBERS 

6.  AUTHOR(S) 

Eve  A.  Ri ski n  and  Richard  Ladner 

7.  PERFORMING  ORGANIZATION  NAMES(S)  AND  ADDRESS(ES) 

University  of  Washington 

Depts.  of  Electrical  Engineering,  and 

Computer  Science  and  Engineering 

Box  352500 

Seattle,  WA  98195-2500 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING  /  MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

U.S.  Army  Research  Office 

P.O.Box  12211 

Research  Triangle  Park,  NC  27709-221 1 

_ _ 

10.  SPONSORING /MONITORING 

AGENCY  REPORT  NUMBER 

f\po  3*/  OS-/0'£L 

11.  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  and  should  not  be  construed  as 
an  official  Department  of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 

12a.  DISTRIBUTION  /  AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited. 

12  b.  DISTRIBUTION  CODE 

13.  ABSTRACT  (Maximum  200  words) 

In  the  research  conducted  under  this  grant,  we  addressed  the  problem  of  transmitting 
images  compressed  with  high  quality  wavelet  compression  algorithms  over  packet 
erasure  networks,  multiple  description  channels,  and  noisy  communication  channels. 

In  addition,  we  developed  new  methods  for  wavelet  image  compression  based  on  group 
testing;  developed  a  variation  of  the  set  partitioning  in  hierarchical  trees 
algorithm;  and  developed  a  method  for  fast  search  of  an  entropy-constrained  vector 
quantization  codebook. 

14.  subject  terms  ^ave]et  image  compression,  vector  quantization, 
packet  erasure  channels,  packet  loss,  unequal  loss  protection, 
SPIHT,  joint  source/channel  coding,  Reed-Solomon  coding, 

Priority  Encodinq  Transmission. 

15.  NUMBER  IF  PAGES 

7 

16.  PRICE  CODE 

17.  SECURITY  CLASSIFICATION  18.  SECURITY  CLASSIFICATION  19.  SECURITY  CLASSIFICATION 
OR  REPORT  OF  THIS  PAGE  OF  ABSTRACT 

UNCLASSIFIED  UNCLASSIFIED  UNCLASSIFIED 

20.  LIMITATION  OF  ABSTRACT 

UL 

NSN  7540-01 -280-5500 ' 


Enclosure  1 


Standard  Form  298  (Rev.  2-89) 

Prescribed  by  ANSI  Std.  239-1 8 
298-102 


1  Statement  of  the  Problem  Studied 


In  the  research  conducted  under  this  grant,  we  addressed  the  problem  of  transmitting  images 
compressed  with  high  quality  wavelet  compression  algorithms  over  packet  erasure  networks, 
multiple  description  channels,  and  noisy  communication  channels.  In  addition,  we  developed 
new  methods  for  wavelet  image  compression  based  on  group  testing;  developed  a  variation 
of  the  set  partitioning  in  hierarchical  trees  (SPIHT)  [16]  algorithm;  and  developed  a  method 
for  fast  search  of  an  entropy-constrained  vector  quantization  codebook. 

2  Summary  of  Most  Important  Results 

In  this  Section,  we  summarize  our  most  important  results. 

2.1  Graceful  Degradation  of  Compressed  Images  Over  Packet  Era¬ 
sure  Channels 

Under  the  grant’s  support,  we  developed  an  unequal  loss  protection  (ULP)  algorithm  to 
assign  unequal  amounts  of  forward  error  correction  (FEC)  to  images  that  are  compressed 
with  an  unmodified  progressive  compression  algorithm,  such  as  SPIHT,  and  transmitted  over 
lossy  packet  networks  [11,  12].  Our  scheme  is  modular  in  that  we  can  use  any  progressive 
compression  algorithm  and  have  graceful  degradation  with  increasing  packet  loss  rate.  That 
is,  if  more  packet  loss  occurs  on  a  network,  the  receiver  will  decode  a  lower  rate  version  of 
the  image.  If  the  network  is  congested  when  someone  tries  to  download  an  image,  instead 
of  the  connection  stalling  while  waiting  for  retransmissions,  a  slightly  degraded  view  of  the 
image  could  be  displayed. 

In  generalized  multiple  description  coding,  N  packets  of  data  are  transmitted  and  possibly 
less  than  N  packets  are  received.  The  goal  is  to  maximize  the  quality  of  the  reconstruction 
given  the  received  packets.  This  is  equivalent  to  coding  for  lossy  packet  networks. 

We  have  developed  a  way  to  use  our  ULP  algorithm  to  implement  a  SPIHT-based  mul¬ 
tiple  description  image  coder  [9,  10].  FEC  is  assigned  across  packets  in  unequal  amounts  so 
that  if  packet  or  description  loss  occurs,  useful  data  can  still  be  received.  Initial  simulations 
were  very  promising  and  gave  results  that  were  higher  than  recent  results  by  Chung  and 
Wang  [2]  by  up  to  2.87  dB. 

Current  extensions  of  this  work  include  applying  the  ULP  algorithm  to  video  compres¬ 
sion  and  developing  a  real-time  ULP  algorithm.  We  have  recently  received  a  grant  to  im¬ 
plement  our  ULP  algorithm  in  the  high  quality  wavelet-based  image  coder  of  LizardTech, 
Inc.  (www.lizardtech.com).  The  goal  is  that  even  if  severe  amounts  of  packet  loss  occur 
on  the  Internet,  a  useful  image  could  be  obtained  from  any  image  server  that  is  using  the 
LizardTech  encoder. 


2.2  Multiple  Description  SPIHT 

We  have  developed  an  alternative  method  for  protecting  data  in  a  multiple  description  coder 
or  lossy  packet  network.  The  algorithm  is  designed  for  SPIHT  but  can  be  extended  to  other 
coding  methods.  It  divides  the  data  into  descriptions  and  adds  redundancy  before  compres¬ 
sion. 

In  this  method,  to  improve  the  robustness  of  SPIHT  to  packet  loss,  we  first  modify  it 
similarly  to  the  Packetized  Zerotree  Wavelet  algorithm  of  Rogers  and  Cosman  [15].  We  dein¬ 
terleave  the  SPIHT  bit  stream  by  combining  spatially  disperse  wavelet  coefficient  trees  and 
coding  them  with  SPIHT  in  separate  descriptions.  We  use  arithmetic  coding  within  each 
description  and  code  each  description  to  the  same  bit  rate. 

Redundancy  is  added  by  placing  extra  copies  of  each  wavelet  coefficient  tree  in  additional 
descriptions.  To  vary  the  amount  of  redundancy  according  to  the  importance  of  data,  we 
code  each  copy  of  a  tree  at  successively  lower  bit  rates.  Each  description  has  fully  coded 
original  trees  and  some  partially  coded  redundant  trees  corresponding  to  different  spatial 
locations  in  the  image.  Results  show  that  high  quality  images  can  be  obtained  even  when 
up  to  half  of  the  descriptions  are  lost. 

Future  work  includes  frame  expansions  [6,  5]  in  the  MD-SPIHT  coder.  In  addition,  we 
are  extending  our  algorithm  to  protect  a  region  of  interest  in  an  image  more  heavily  than 
the  rest  of  the  image  [8]. 

2.3  Group  Testing  for  Image  Compression 

We  developed  a  novel  wavelet-based  compression  algorithm  based  on  the  concept  of  group 
testing.  We  call  this  algorithm  Group  Testing  for  Wavelets  (GTW).  Group  testing  is  a  tech¬ 
nique  for  identifying  a  few  significant  items  out  of  a  large  pool  of  items.  Whereas  Shapiro’s 
embedded  zerotree  wavelet  (EZW)  coder  [17]  and  SPIHT  rely  on  zerotrees  to  code  wavelet 
coefficients,  GTW  codes  wavelet  coefficients  in  groups  that  do  not  have  to  be  zerotrees. 
Therefore,  GTW  is  a  generalization  of  the  EZW  and  SPIHT  algorithms  and  should  be  able 
to  offer  better  coding  performance. 

Our  results  showed  that  even  though  the  GTW  algorithm  does  not  use  arithmetic  coding, 
it  performs  comparably  to  the  SPIHT  variant  with  arithmetic  coding.  It  outperforms  SPIHT 
without  arithmetic  coding  oh  the  Barbara  image  by  up  to  0.7  dB. 

In  our  future  work,  we  will  extend  GTW  to  image  transforms  that  are  of  lower  complexity 
than  the  wavelet  transform,  such  as  the  discrete  cosine  transform,  and  to  the  compression  of 
wavelet  packet  coefficients  [3,  14,  4].  We  believe  that  GTW  will  be  particularly  well  suited 
for  coding  wavelet  packets  since  wavelet  packet  coefficients  are  more  difficult  to  group  into 
standard  SPIHT-like  zerotrees. 


2.4  EZV 


At  StatSci,  the  subcontractor  on  the  grant,  we  carried  out  a  rate-distortion  analysis  of 
Shapiro’s  EZW  coding  algorithm.  We  also  developed  a  variation  of  embedded  zerotree 
coding  that  we  call  EZV  coding.  It  uses  a  1-bit  alphabet  and  1-depth  lookahead  coding  in 
the  EZW  algorithm.  EZV  codes  the  same  information  as  the  EZW,  but  more  efficiently, 
resulting  in  significant  bit  savings  for  the  same  information.  Code  for  this  work  has  been 
implemented  in  StatSci’s  Splus  Wavelets  2.0  module. 

2.5  Fast  Search  of  Entropy- Constrained  Vector  Quantization 

Entropy-constrained  vector  quantization  (ECVQ)  [1]  offers  substantially  improved  image 
quality  over  ordinary  vector  quantization  (VQ).  It  uses  a  Lagrangian  distortion  measure 
that  trades  off  the  distortion  between  an  input  vector  and  a  candidate  codeword,  and  the 
cost  in  bits  of  sending  the  codeword  (its  entropy).  Larger  VQ  codebooks  offer  higher  image 
quality  for  a  given  bit  rate.  The  drawback  of  using  an  extremely  large  codebook  is  that  it 
requires  high  complexity  at  the  encoder. 

There  has  been  a  substantial  amount  of  work  in  the  literature  for  fast  search  of  ordinary 
VQ,  which  uses  the  mean-squared  error  as  its  distortion  measure.  We  developed  a  new 
technique  for  fast  search  of  ECVQ  [7]  so  that  larger  codebooks  can  be  used  in  ECVQ  with 
manageable  complexity.  We  use  a  new,  easily  computed  distance  that  successfully  eliminates 
most  codewords  from  consideration.  Speedup  over  exhaustive  search  of  a  size  512  codebook 
of  4  x  4  vectors  is  almost  20:1.  It  can  be  used  with  any  variant  of  VQ  that  uses  a  Lagrangian 
distortion  measure,  such  as  Bayes-risk  VQ. 

2.6  An  Empirical  Study  of  Fast  VQ  Search  Algorithms 

In  related  work,  we  compared  six  nearest  neighbor  search  algorithms  for  performing  VQ. 
Orchard’s  Method  [13],  the  Annulus  Method,  and  the  Double  Annulus  Method  are  algorithms 
designed  specifically  for  VQ.  The  k-d  tree  nearest  neighbor  search  algorithm  is  a  traditional, 
general-purpose  algorithm.  The  last  two  algorithms,  called  the  PCP  tree  and  the  PCP /k-d 
tree,  were  newly  developed  by  the  authors. 

These  six  algorithms  are  compared  empirically.  The  results  of  this  study  are  the  following. 

•  All  six  algorithms  are  vastly  superior  to  “brute-force”  search. 

•  In  low  dimension  (4  or  less),  the  k-d  tree  is  the  fastest. 

•  In  high  dimension  with  small  codebooks,  Orchard’s  Method  is  fastest.  However,  the 
memory  requirements  of  Orchard’s  Method  make  it  impractical  for  all  but  the  smallest 
searches. 

•  The  PCP /k-d  tree  is  a  competitive  alternative  to  Orchard’s  Method,  and  is  the  best 
general-purpose  algorithm. 


2.7  Recovering  from  Bit  Errors  in  Images  Compressed  with  Wavelets 
and  Scalar  Quantization 

We  studied  the  effects  of  transmission  noise  on  fixed-length  coded  wavelet  coefficients.  We 
developed  a  maximum  a  posteriori  detector  that  uses  inter-bitplane  information  to  determine 
which  transmitted  codeword  was  most  likely  transmitted  for  a  given  received  erroneous 
codeword.  We  presented  a  simple  method  of  recovering  from  these  errors  once  detected 
and  applied  our  restoration  methodology  to  scalar-quantized  wavelet  coefficients  that  were 
transmitted  across  a  binary  symmetric  channel.  Results  show  that  our  method  can  increase 
the  peak  signal-to-noise  ratio  by  nearly  4  dB  for  the  Lenna  image  transmitted  over  a  binary 
symmetric  channel  with  an  error  rate  of  1%. 
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